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ABSTRACT 



This content analysis study evaluated the research 
methods and statistical techniques employed in studies reported in 
the professional journal, "TECSE" (Topics in Early Childhood Special 
Education) between 1990 and 1993. Research articles comprised 37 
percent of all articles (n=120) published during this period. The 
most frequently utilized statistical techniques were descriptive 
statistics, t~tests, multiple regression, analysis of variance, and 
correlation* Nonintervention designs represented the majority of 
research articles, with causal-comparative being the most prominent 
type. Of the intervention designs, pretest/posttest was the most 
frequently utilized method. The majority of article authors were 
female. (DB) 
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Abstract 

The primary purpose of the present study was to examine 
the research methods and statistical techniques employed 
in the Topics in Earl y Chi Idhood Special Education 
research articles between 1990 and 1993. The most 
frequent 1 y utilized statistical tec hniques were 
descriptive statistics, t-tests, multiple regression, 
analysis of variance ( ANOVA ) , and correlation . 
Nan in terven tion designs represen ted the ma j or i ty o f 
research articles, with causal -comparative being most 
prominent. The number and gender of article authors were 
also addressed* 
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The Use of Research Methods and Statistics 
in TECSE , 1990-1993: A Content Analysis 
Five types of manuscripts are published in Topics in 
Earl y Chi ldhood Special Education (TECSE): original 
research, literature reviews, conceptual statements, 
position papers, and program descriptions. This study was 
most interested in those TECSE articles published as 
original research. Our focus was on what research methods 
and statistics were represented in TECSE articles 
disregarding the topics on which the research was done. 
It was felt that this in forma t ion wou Id provide ind ica tors 
of the research and statistics knowledge bases valuable 
for understanding and appreciating not only TECSE 
articles, but res<?a^n reported by other means or ±1 other 
j ourna 1 s . 

There have been a number of studies which 
investigated the quality and quantity of research methods 
and statistics in articles published in the journals of 
education (Goodwin & Goodwin, 1985; Sabatino, 1981; Ward, 
Hall, & Schramm, 1975; West, Carmody, & Stal lings, 1983; 
Willson, 1980). Sabatino (1981), for example, examined 
four major special education journals over a 5-year 
period, 1972-1977. One of the major focuses of his study 
involved the content analysis of the research designs 
util ized in the 1 i terature to determine whether journal 
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con ten t was practical in facilitating communication 
between consumers and researchers. The results of the 
study showed that a significant portion of the articles 
across the journals were experimental in nature, and that 
there was a decline in professional issues and position 
papers over the years . 

Goodwin and Goodwin (1985) also evaluated the types 
of statistical techniques utilized in the articles 
published in the 1979 to 1983 issues of the American 
Educational Researc h Journa 1 . Their purpose was to 
examine the extent to which the content coverage of 
graduate- lev© 1 statistics texts matched the statistical 
tec hn iques used in the articles. They cone 1 uded that 
almost 707. of the statistical techniques used were at 
either the basic or intermediate level of complexity, and 
that an understanding of both levels of statistical tools 
was essential to become better informed consumers of the 
journal . 

Given that educators and prospective educators in the 
field of special education gain and exchange knowledge 
largely through professional reading, a periodic update of 
the current usage of the research methods and statistics 
and of their trend would seem requisite to understanding 
the professional research literature. The primary purpose 
of the content analysis of the present study was, 
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therefore, to provide a synopsis and overview of the 
methods and statistics represented by TECSE articles over 
a recent 4-year period, A secondary interest was in the 
number and gender of the article authors. 

Method 

Artie les 

All articles, except book reviews , published in 
TECSE for the four year period from 1990 to 1993 were 
selected for this study (N=120). The 120 articles were 
separated in to two categories: research articles 
(original research) and non researc h articles (literature 
reviews, conceptual statements, position papers, and 
program descriptions). The research articles were further 
examined to identify the types and frequencies of research 
methods and statistical techniques used. 
Types of Methods and Statistics 

The statistical techniques used in the research 
articles were coded as basic, intermediate, or advanced 
techniques. The research methods used were coded as 
intervention or nonintervention. Intervention designs 
required the manipulation of a variable, whereas the 
nonintervention designs did not. The specific types of 
statistical techniques and research methods are outlined 
in Tables 1 and 2, respectively. 
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Coding Procedure 

Non research ar tic les were coded by the subcategories 
as presented earlier. For research articles, two coding 
forms were developed. The form used to code the 
statistical techniques was modeled after Goodwin and 
Goodwin's (1985) classification of statistical techniques. 
A statistic was counted only one time per article even if 
it appeared more than once. The coding form for the 
research methods consisted of several types of designs 
listed under the main headings of intervention and 
nonintervention. When more than one research method was 
employed in a single article, each method was coded into 
the appropriate type. Consequently, the total number of 
research methods exceeded the total number of articles 
reviewed. In addition, articles were also coded according 
to the number and gender of authors. The authors were 
coded as single authorship, co-authorship, or multiple 
authorship. The gender of each author, in relation to the 
order of author 1 is ted , was also coded . 

The authors of the present study independently coded 
the 32 articles in the four 1990 issues. This was done to 
determine coder consistency. Agreement was 9< , .%. The 
first author subsequently coded the 1991 \ssues, while the 
second author coded the 1992 and 1993 issues. Any 
uncertainties were resolved by returning to the articles 
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and both coders reaching consensus. 

Results 

Nonresearch articles represented a significant 
portion of content in TECSE during the 1990-1993 period, 
accounting for 63"/. of the articles reviewed. The majority 
of the nonresearch articles included posi tion papers . 

With respect to researc h ar tic 1 es , Table 1 presen ts 
the frequency of statistical techniques used, relevant to 
the types reviewed. As can be seen from Table 1, the 



Insert Table 1 about here 



basic techniques were the most frequently utilized 
statistical tools (72*/.), of which descriptive methods were 
most prominent . Al though the basic techniques accounted 
for the majority of nhe statistics used during the 
1990-1993 period, there was a trend indicating a decrease 
in the use of the basic techniques, coupled with a steady 
decline in the use of descriptive statistics. There was, 
however , no clear pattern of a correspond ing increase in 
the intermediate or advanced tec hniques . Of the 
intermediate techniques (16V.), multiple regression was 
most frequently employed. Least found were the advanced 
techniques ( 127. ) . 

A further examinat. on of Table 1 was conducted by 
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comparing the frequencies of all statistical methods 
listed. Descriptive statistics, t-tests, multiple 
regression , analysis of variance ( ANOVA) , and correlation 
were most used in relative frequency and represented 81 X 
of the total statistical methods employed. None of the 
research articles published between 1990 and 1993 used 
p 1 anned orthogonal comparisons , trend ana lysis, factorial 
analysis of covariance (ANCOVA) , part/partial correlation, 
discriminant analysis, path analysis, or meta analysis 
listed in Table 1. 



Insert Table 2 about here 



The frequency of research designs used in TECSE from 
1990 to 1993 is shown in Table 2. The majority of the 
research articl es ( 687. ) represen ted non in terven tion 
designs with the causa 1 -comparative method being most 
frequently used. Furthermore, there was an increase in 
the use of the causal -comparative me thou over this period. 
Other non intervention designs showing relatively high 
frequencies included survey and qualitative methods. 
Of the intervention designs (327.) , pre-test/post~ test was 
the most frequently utilized method. 
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Insert Table 3 about here 



Tabl e 3 provides the number of authors for eac h 
article and their respective gender across both research 
and non research articles. The number of authors per 
article was fairly evenly divided, although multiple 
authorship was slightly more prevalent. With regard to 
gender, the majority of the authors were female, and this 
trend continued throughout tne period . 

Discussion 

With the renewed focus and emphasis on early 
childhood education since the passage of P. L. 99-457, it 
is not surprising that nonresearch articles, particularly 
position papers, represented a large percentage of the 
TECSE articles during the years 1990-1993. One would 
expect that such massive legislation would result in a 
surge of professional issues and position taking in the 
field. 

In regard to the usage of statistical techniques in 
TECSE research articles, the most frequently utilized 
statistics were similar to those reported by Goodwin and 
Goodwin (1985) including descriptive statistics, multiple 
regression, ANQVA , and correlation which are either basic 
or intermediate in levels of complexity. The other basic 
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technique most frequently employed in TECSE was the 
t-test . In addition , a dec rease in the use of descriptive 
statistics was readily noticeable, which is consistent 
with the previous findings (West et. al., 1983) indicating 
a trend toward more robust statistical methods . 

Unlike the results of Sabatino's (1981) study, the 
majority of the research articles in TECSE from 1990 to 
1993 represented nonintervention designs such as causal- 
comparative, survey, and qualitative studies. It is 
likely, qiven the pressing needs for service delivery of 
children developmental ly at risk, that research in early 
childhood special education ma/ be primarily field based 
where opportunities for random assignment and 
establishment of control groups are difficult to achieve. 
This could further explain the high frequency of the 
causal -comparative method and increase in its use over the 
peri d. 

As to the number of authors per article, it was 
fairly even ly divided with the majority of the authors 
being female. The greater number of female authors seems 
to reflect female dominance of the field as men tend not 
to choose early childhood education as their career for 
'various reasons speculated elsewhere (Seifert, 1988). 

Overall, the results of the content analysis of the 
present study were comparable to those of previous studies 
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in terms of types and difficulty of statistical 
techniques. However, there, were several unique aspects of 
TECSE research which appeared to be germane to the field 
of ear ly c hi Id hood specia 1 education , that is , more 
field-based studies and greater involvement of females. 
Generalizability of these findings would be enhanced by 
similar studies being conducted in TECSE and other 
journals in education on a periodic basis. Bringing 
content analysis of the journals up to date is also 
essential for keeping consumers informed as to trends and 
usage of statistical and research methods. 
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Table 1 

Tec hniques by Frequency and Percen taqes of To ta 1 for 



Basic , Intermediate , and Advanced Statistics 



Statistical 1990 
tec hn ique 


1991 


1992 


1993 


Frequency "/. 


Descriptive 


12 


10 


7 


5 


34 


Correl at ion 


3 


1 


1 


1 


6 


Chi square 


2 


0 


0 


3 


5 


T-test 


1 


8 


4 


3 


16 


One- way ANOVA 


2 


• 1 


1 


3 


7 


Total basic 
tec hniques 


20 


20 


13 


15 


68 72 


Factorial ANOVA 


2 


0 


0 


1 


3 


P lanned orthogonal 
comparisons 


0 


0 


0 


0 


0 


Post-hoc multiple 
comparisons 


0 


0 


1 


o 


1 


Trend analysis 


0 


0 


.0 


0 


0 


One-way ANCOVA 


0 


0 


0 


1 


1 


Factorial ANCOVA 


0 


0 


0 


0 


0 


Part/partial 
correl ation 


0 


0 


0 


0 


0 


Multiple regress. 


2 


1 


4 


3 


10 


Total in termedi ate 
tec hniques 


4 


1 


5 


5 


15 16 



( table continues ) 
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Statistical 
tec hn ique 


1990 


1991 


1992 


1993 


Frequency 7. 


Discriminant 
ana 1 ysis 


0 


0 


0 


0 


0 


Path ana lysis 


0 


0 


0 


0 


0 


Canon ic a 1 

correlation 


1 


0 


0 


0 


1 


Factor analysis 


3 


1 


0 


1 


r j 


Cluster analysis 


0 


0 


0 


1 


1 


One-way MANOVA/ 
MANCOVA 


1 


0 


0 


0 


1 


Factorial MANOVA/ 
MANCOVA 


1 


0 


1 


1 


3 


Total advanced 
tec hn iques 


6 


1 


i 


3 


11 12 


Totals 










94 100 



ERIC 



14 



Con ten t Analysis 
14 



Table 2 

Frequency and Fercen taqes of Total for Interven tion and 
Non intervention Researc h Designs 



Researc h 1990 
designs 


1991 


1992 


1993 


Frequency 7. 


True &xD(= a riiTiRn , t" 


2 


1 


0 


0 


3 


Hi ijc ■{ -py npr i fnpn f" 




2 


0 


1 


3 


Pre- test /post- test 


1 


5 


0 


2 


a 


Sing 1 e-subjec t 

( f i mp cpri pc ] 




2 


1 


1 


4 


To ta 1 in tervent ion 


3 


10 


1 


4 


18 32 


Case study 


0 


1 


1 


0 


2 


Survey 


2 


1 


3 


2 


8 


Longitudinal 


1 


4 


1 


0 


6 


Cross-sec t ional 


0 


0 


2 


0 


2 


Correlational 


1 


1 


1 


1 


4 


Causa 1 - 

Comparative 


1 


1 


3 


5 


10 


Qual i tat ive 


3 


1 


3 


0 


7 


Total non- 
intervention 


B 


9 


14 


B 


39 68 


Total s 










57 100 
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Table 3 



Frequency and 


Percentages of 


Total for 


Number 


and Gender 


of Authors 












Number of 
authors 


1990 


1991 


1992 


1993 Frequency 7. 


Single author 


9 


10 


9 


10 


38 32 


Two authors 


9 


8 


10 


10 


37 31 


Mul tiple authors 14 


12 


9 


10 


45 37 


Gender of 
authors 


1990 
F/M 


1991 
F/M 


1992 
F/M 


1993 
F/M 


Frequenc y 


First author 


17/15 


22/7 
1? 


16/11 
1? 


22/8 


77/41 
2? 


Second author 


15/5 
1? 


12/8 


11/8 
1? 


9/10 


47/21 
2? 


Third author 


9/3 
1? 


8/4 


8/1 


6/4 


31/12 
1? 



Note. The "?" within the gender of authors table 
represents that the gender of an author could not be 
determined based on the information given. 
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